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(54) VIRTUAL STORAGE SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To flexibly perform data 
access in a distributed environment. 
SOLUTION: A host 140 is connected through a network 
130 to a storage container 160 and connected through a 
communication channel 132 to a controller 120. An agent 
1 10 prepares a virtual mapping table by mapping real 
storage position on the plural storage containers 160 
and positions inside a virtual disk 150 and stores it in a 
volatile memory 111. This table is stored on a 
semipermanent memory 121 of the controller as well, 
and the table in the memory 1 1 1 is intermittently 
replaced with the table in the memory 121. By means of 
distributed virtualization, the controller can manage a 
large number of virtual disks to be used for a large 
number of host systems and a single virtual disk can be 
shared by a large number of host systems as well. 





1 — 


■fl 


f) 


I* 1 








II- 










=? 




B 












A 






n 


* • 




t. 





IL- 



LEGAL STATUS 

[Date of request for examination] 

[Date of sending the examiner's decision of 

rejection] 

[Kind of final disposal of application other than 
the examiners decision of rejection or 
application converted registration] 



http://www1 9.ipdl.jpo.go jp/PA1 /result/detail/main/wAAA0IaqPZDA41 4091 706P1 .htm 04/02/1 8 



Searching PAJ 



2/2 ^— v 



[Date of final disposal for application] 
[Patent number] 
[Date of registration] 

[Number of appeal against examiner's decision 
of rejection] 

[Date of requesting appeal against examiners 
decision of rejection] 

[Date of extinction of right] 

Copyright (C); 1998,2003 Japan Patent Office 



http://www1 9.ipdljpo.gojp/PA1/result/detail/main/wAAA0IaqPZDA41 4091 706P1 .htm 04/02/1 8 



mx&< 12 h) 



(19)0*BI#ff;? (J P) 



(12) 



4# ff & $g (A) 



(lOWfrfflH^ra*^ 
#^2002-91706 
(P2002-91706A) 

(43) IkM 0 ¥«14^ 3 R 29 S (2002. 3. 29) 



(51)Iut.CL 7 
G 0 6 F 3/06 
12/00 



3 0 1 
5 4 5 



F I 

G 0 6 F 3/06 
12/00 



7-n-r(0#) 

301J 5B065 
545A 5B082 



m&m* Tfcif* m&m&ms ol ^a^tu^ (^39S) 



(21)fflS#^ 


ftmZQQ 1 - 1 661 24( P2001 - 1661 24) 




500039223 










(22)HiSJ0 


¥/&13*£63 1 0(2001.6. 1) 




a^-X U^fyH A— h 










(31)«$fcffc£3g^ 


6 0/2 0 9 1 0 9 




Compaq Information 


(32)«5fc0 


¥fiK12¥6E 2 0(2000. 6.2) 




Technologies Group, 


(33){g$fc«tt3gH 


*H (US) 




L. P. 


(31)«$fcffi£5g#^ 


6 0/2 0 9 3 2 6 






(32)«ft0 


¥/&12*£6£ 2 0(2000,6.2) 




XX X-f^ 249 20555 




*a (US) 


(74)ttSA 


100089705 








#«db tfc* W5« 











(54) umnzm fiiS2»^xfA 



(57) [KM] 

h 1 4 0tt*y M7 — 3 O^r^L 
TX h U — • ^ >"7^ 1 6 0 (C, iiff ^^^JV 13 2 
^tt^y 1 2 0«g$W o 

hiioit fflfBcco-x h v> • 3 Vt"*- 1 6 0 ±<DM 

^yn liciBts-r^o K^-^Mi^^hD-^^^ 
y^mt^v i 2 nctiattstt, 1 1 l*^— ;/ 

/u^^^ey i 2 iot 1 — ^/ufcilB*»«**ix*. # 
x x A tJS m v ^ § ftRofi*^ -f x * £ £ c £ a* "C 
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[4MW9**>«Sffl] 

[f9**l ] *v YV — ^£riiDT*;* h£ l£A_b 

jucom i => tr-*riB*i-6ii*tt> * y *rtf-t-**— 

^> hi* 

-£E«1-£*fl«8tt* * y *r*U t 1 — ^©JSia 
tr— cof*j^&, v 1 — y/uo^2 33 tf— ^>i*j*i mettle w 

wtujc:J:9, Afcti^J (I/O) WjtfwM. htt, ^ 
— v^V h JittlE«£ftT^£^— iZ/M^^v h y <£> 
loiCT^ir^LT. E«K«^EttM9rG> 1 ofc*S 

[ft** 2] W*3jl|E«©i/^^A|Ci3V^r, 

6 <fc 5 * tiX v > 6 r k £ "T S ix* -r i> 0 
[»*|3] »**2fi*os/*^.Mc*5^-c. 31- . 

[f9**4] IS*«11B«^^^^(C*3V^-C, 
[19**5] fS*^4E«^^X^tC*5V>r, 3i- 

[IS*:* 6] tf^ifB®^v'^xAlc^v>-c, B2r> 
[If!** 7] fS**6E*t<^>*^l-#^*C> iift 

[19**8] ■ 19**1 E«G>^*^-MC:|8V>-C* 

[19**9] «*«8Ei©^fA|:*5^"C, ^-7 
-try htt:Ma=y h «r*trwt*»«4: -T 



4$M 2002-91706 
[«*«10] 89**8E«^:>'*7 i AV\fc^T* tf- 

[19**11]. §9**1 0fE«<D^*xAK:fc^T, 
3i>- h y tejefcUKfflr^ *^fitE<£Hr^7< > hfr^tf^ 

[§9**1 2] {Rffi^-f • i?^ v h^tStS^B 

3i > h y ^tttt«:*-r«»oaE*t, 

[19**1 3] 18**1 2E«O^^A|Ci3V^, 

[ii**i4] t9**i zmm^s^Mc&^x, 

[§9**i 5] 19**1 4E«<0^^7 i A(C*5V^T > 
* . yptMb lMBXfflf&ZthX^ZZk&m 

[19**1 6] 19**1 2fSiR^VX^i,lc:^^T, 

[»**i 7] 1***1 2E«feov^7 i Atc:*5v>r, 

[ft** 1 8 ] IS** 1 2 EfcCD^^^lCfcV^. 
[fl**l 9] |f**l 8Ett^">^7 t ^^*3V>-C, 

[f»**2 o] it**i 2ia«co^^Atc^^r, 

[IS** 2 l ] B*5 2 0EtW^7A|:i3^t, 

[If** 2 2] 11**1 2jE«cC0v'^7 1 AiC^^-C, 

[19**2 3] 11**1 2E«£^v'^^^»C*3V^r, 

[It** 2 4] *y h!7 — ^F^tdfc^^^ hlw^^ 
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MfP*«l&-*- 5 ^ * -f k s 

[»#«2 8]' »*3g2 4|B*CO*-ffi*C*5V>-C. 

[f**S2 9] 1**92 4fS®(0*-ffi(CioV>T, 
[1**93 0] 1**92 4|E«(D^JC*5^T, ^> 
[f**9 3 1 ] *!/ h!7 — ^UlSS^TiEffil^-f • 

[f**93 2] tt*93 iia«co^r&ic*5^r, 
[1**^3 3] w*«3 i&m<o*m£&^T, 
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»fls+fc, K«f -f ^ ^ J:©^ d y ^ tttjgt S ^ f y 
7k, 

yMCT^ir^-t^^v-yyt, 

fiiBf -< * * -boBbfls £ ffi IB** *> S »JS"T 6 »fls«:IB* 

[§S*93 5] ^-;F!7»^m^iKgf^^ • 

tt $ tt fc "a > - * am ^ ffi ^ b <c 5 = >- tr a - 
^VTtk. 

i^Po 

[000 1] 

[HitttiK] *a«tt, 2 o o o^en 2 q^tbKsn 

fc#BffifciJJfiSS6 0/2 0 9, 1 0 9tM6 0/2 
0 9, 3 2 6^^0«MSt5o ^Ofe^ 

[0 0 0 2] 
[0 0 0 3] 

[«*<d«*i *^3>-t: o ^-^ii, mi (a) 

[0 0 0 4] ^ , &BJT>*f'*<< * SrlE«3SBlC»a 
^Miftottfc. ^©te*. mi (B) 

^ (SAN) $r^Ufc« SANIt m%\ lOj^JiCO 
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*V h? — ? • 7?-tX • •V'—'<&ffliX^ SANlC:fctt 

•^y^-7x-^ (SCSI) ✓<*£iiDT»JK1-*L 

(L UN) Sr/fl^Tf*— ^K1M0f«:»^*-5 o #E« 
fiSfifffi, #UB<z>E1S3£ta, Xtt 1 o«DEtftS6«0> l E# 

(zoning) h • = ^ 5 

^.ticx^x, sanj*. $4<k ^Hfc^-^ISH!; y- 

^Sr^T-rS^tAS-cfrSo -OS AN£^Ufc1r-*fe 

ttyy— *<0#*ni, i*or- **tfEtMf3MWB* 

fc^-fe^^y^-faffitW^ttSo -*Ui, SANttx 
jK«:JBv^cilcJ:o-C, *AW;rt (I/O) 

ttfw»«£n*«>-e* JK^-*E««/fi£fflv^» 

ANI1 b&TJ^ h *J - =*>y"±f®<OM&RXf 
LTlMtsU E«»3L 

[0 0 0 5] rftbo^glofctf)^ SifiC^ot, 51 
SAN p&S IcffifflWfc; W -V «ril*n Lfc 0 jE«flS V" 

Mrf 4 ^?<DT~7* v'a > (abs tract i 

on) tltt-^W^V'-f^X^.' ^f-MC^ 

MJftSix, ^Eb^ti, ^Lt, ilRBNcfi^ 
■ere** h ^fc^-rsicb^i^or, &3g£n 

SANy y-^^-^/UWlW^l^SAN 
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[0 0 0 6] L**L&**e>* ffi*<0^;**&tfE1ftiJ" 
y^fA^t^SANH 3yea-^"^7^ 

ft, *<r— 9 try-^-f tP&££*L6 0 JCtci. SAN«S 

^wt^*jits^ h ^— V s • y y— ^<o^»dsfc-5o 

/0 [0 0 0 7] Lfc^oT. SAN|:M5Ctlb&^ 
©E«»ttA»e>»(lti-*w4:lcJ:o"C, SANOtttBS: 

'20 -t-SCfclcJioX. fi»fltfMB#iJ--- ^(blWlSixS 
ANIcHA£*l5 0 a*©*— /<R5fejt*tt«icJ:or 
WLttbifrZ>* hU- ^COiK^blcAPX-r, SANiiOiS 

[0 0 0 8] 

30 (A) (C) lC^:tt^tb^-r«t 51-, ^^H, ^ 

B8JHS:lfil»-*"'5o U*»Lft* s 6, lo^^y^- ^>-h 

[0 0 0 9] 7 try x>ro^#fi. 55-tSciRSWtE 

Ale J;o tft$ w j § 0 u&»Lfta*e>. 

{RffiikEti^^'r^SrifKfifcU. {RfflE«^*5V^Tfflv>e) 
^al^^^^^Tl^T U^f (RAID) ^^JPl^tt^o 

^s^b, Ett^^Acoajai. ^u^x— ^ta^fe^K 

50 ttcoPnlM^tf, 9^ft<EaE«V^^^«>» 
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[0 0 10] 

«£Wt #1ft^—^/u«b Attics' f^Srffli^fc 

it ^> hn— 7 b\*mm<o&&<o$Ln^yv>? • ^ 

ft ^ytf^^-^-^/uoacttttiattSrfflSCtlcJ: 

•31— v^i'Mt fiilOO^y tT^^ • 31— h£|* 

-*^hl»*Jc»r*ii8tt*rlKai)a^kAS»*Lv\ 

[0 0 1 1 ] 

[#W0>SSJfc0>»!B] §3-i6 KtkT J: 5 fc> 

ft h 1 4 OM-^ Mx— • ayftl 6 0WJ© 

AW* (I/O) ibf^©fc*lc lo^LkcoiEBx'f 

1 5 0*»a-r*fc*fciK*<C. . 1 ^-b<0^»^ y 

.*yh!7-^ (SAN) «r«flrrS 0 BP*>. 

2 0 0ft ^ffix -f * ^ 1 5 0 ft<D{±LW h • 

tit «T"eHI-»U<RWr5o 

[0012] * h . 31 y T • ^> h 17 

^ .(SAN) 605fc&«r^fe^-r5o Ifc^oT, ^ 

wit fc^^sa^F^^-^^-^iso 

fcSffl*Tffi"CS>5o SAN^T-ft 7H/-^'3yf 

^ h i 4 oft n^tf^— £\ >-^> 

^fCffilKL;* h \s— *J • xi 1 6 0frh<D"r—9\Z 

[0 0 13] mm^. b • *V YV — t 1 3 0 
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ft /J%gJ=i a — • i/^^A • — 7 m — .X 

(SCSI) Xli7 7^ '< ' ^^-*/KOffl><rO||JSfl8« 

H«6ffi«^ 1 o-CIt * h U— i? • * y h !7 — ^ 13 0 

/o -f5 0 L*»LJfca*e>, y^j^ i o ocos^f+ft 

WSttT^^jrV^ h t • ^5/ h 17 — ?%<£tsWL<Dm 

h ^ ' h!7-^ 1 3 0±fC4oft6^ffiti 

[0 0 14] t^M40H i/o®j^3^>- K£r<£ 
if^^^ i 5 Ofc^nb, ^mcJSftt, -^y 
^ • 3i— v? x y Mi 0 (j;r-/^2 o Ofcr^ir^i- 
^ 0 m— ^^>- hi l ote—j&fcte ? fcur^^. 

h l 4 Ofc^ig^ft^n^^, x-i/xy h i i oteT- 
— y/U2 0 0^:^^ h 1 4 (XDTf-t^frbMMZit 

yhllO^U hsftSSU^B©-^:/ tf^^ ■ 

^/U~2 o o J: 9tci-£ 0 *>-5v>fi, ^rAi 

OOfi, fflfBco*^ h*S3i— v 5 *^ M i otcffiSK-TS 
J:5lc«ri£-r5r.i:t>prfB"-e*5. M 4 0 

f^Cx-i/xy h i l oicgMt^i^ h 1 4 
0 ft »^f-^2 0 0 I^f57 ^ t 

[0 0 15] 3i— i/^ls h 1 1 Ofi, ftMfftf-fiDRA 
Mt'fc^ffW^y 1 1 1 K-*y¥^lf • ^— y/U2 
50 0 0^IStti-5o x-i/xVh l 10(010 

yhll 0f^:g^<o^— ^2 0 0(D^b°— $r^9o 0fl 
x.ft -^y yds? • 3i— Ml 0^7^^ h • 

t 1 a i 4 o ^<^m*^^^^^ h • > 

^M40(j:, 3i— i/oi^ Ml 0— ^l^^rilfftS 
- ^C^ot, y • x-y x y Ml 0 $:#lh 

fS:^5t'^o u^we>, r-^2 0 0^rff 
40 38t£;*^ey fd|21t-rsr kkcXoX, t-^2 0 0 

x-^xy Ml o±-CSSlcr*-fe*&i^JSa s 

tt^^ey tc|E1E-r6w <htcj:oT, 31— ^^vMio 

*^hfc L-c^m-r^xT^ h& 

^— ^yM lOfi, ttffilctS**-^ tr 

[0 0 16] WAlOOfl, ^yhc- 71 

50 2 0MX., x-v?*yMl0tll»lJit?fc5^ 
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— h i i cHc^fft-rSo rs/evmwiis 

hP-y 1 2 0ld^qMfc£*x-t^<5o sic, 
3> 1 2 Of*, 0 OSr^fcfrl 

00 ;*^y i 2 itcfcisffiu i^ts' V?V^<Dmz.h 
= v Hp — 7 l 2 o^-r-^2 0 0Sr«fiPi-5J: 5^ 
t5 0 ^*jK>*y 12 111 <fc0>Hre«SJ&&tfiBj£ 

V\> fcSi^ft =iyhn-7l 2011 *i&^Tffi*3t«E 
M^ft/D ^7 ^ TO> ^ y o J: -ecoYt&co 

t8Ur*>J:v\ ~<D£?\C^ =iy ha-7l 20(1 =» 
y hP-7 1 2 O^v'-T -7 t- 

[0 0 17] >icoJ: 9 v^t'y^ • t=— XA"2 o 0 
©3lc«cWIB««, 1 2 0(O^#jT?fci9, =i 

• Ml 0RXf=* VFn-712 ONJtfW 1/ 

^CD4 1 "C> i/xV hi 1 Oft ^ > 1 2 

tT4toftv^fc3fts#*bv\ *<ott*, v^-r^i 0 o 
ft ^^fc^^-7^r% 3^3^-^^h<o»»^*f 

[0 0 18] «T^K9H-5«fc5u:, ^>hp-? l 2 
OM^-^xVF l i o^flStfMBft «ffi&tfy * 
— ^ffi-e£«*tt-5o m 3 Id^-Tfi©-^ * ' 
x^o— jns»»"ett, sMtn ant^-v^/n 3 2co 

Aio 0«>9J©3llM»«"Crt:, A" 1 3 2tt 

^ h U-v^ • ^5/ h !7-^ 1 3 0 g^-Cfc6o 

as-etio i«f-^n3 0tt, tcp/ipoj:? 

*>ffiffi"siffi-cfc5o Fo-7 i 2 o<o«iear^r^ 
tr^-r Woffle offiSf^ffljeov^tt, «T"T?SEK 

[0 0 19] H5&tfl2I6H r-7'/i/2 0 0gqj*jS£: 
«EB&WJC7^UTV>S 0 m&e>£?iz, r-^2 0 0 
ft lo^iOHr^^ • "fc^V ^ h 2 2 0 k* h 
U-v> • zil/^r-r\ 6 0±^>|S®^M2 3 0i<DH^ 
y f^y^tt^ h y 2 1 0 Wt) Sr^tPo IBttffliBff 
2 3 0 ft -m^r h v> - =i 16 0, .Rt^S 



(6) #fM§ 2 0 02-91706 

/0 

2B^-f . s(>"r y?*2 2 0 icSti^S-* hl/^ 

. =i >-7^ i6o (DSfis^srWffi-j-So latBfflef 2 3 0 CO 

■C*»ttttf*?><CV\ SCS I^y h!7 — *-Cftt B® 
IF/r2 3 0©^lt LUNaS^2 3 3 i:, ^"7ir^ 

- r— XA" *xy hy 2 l 0ift<Di&<D7 K^X 

[0020] si 5 tcT^-r «t p fc, y t'>-i/ • x-y/u 

/0 2 0 Of*. 1SMrf<<*9 2 2 0 (D& << • 7* y 

? j i oco^^ hy 210 $rft6 n 1 a*-e# £<> 

<fc^tBA«ST«r«<. BiJ^S«fc»«B-CKt *vytry 
• XA" • hy 2 1011 ^Sl^ h t — • 3 
6 oco io»c*Jlt5»SE^ci 

— y^r^i-o CCOt^— y^2 0 Oco^l^f*, -^s/tfv-^ 

[0 0 2 1 ] -*\ «Ki4*lfc»tt«>^— >^/U2 0 0 
f*. s/ b°>>/ • . xy h y 2 i o $r^v^r*5 

•9 , , m 6 Ict^-TJ; o \C l oco^ h • =i ^ 
6 OfC^s/fV-^i-Sffi^S^^^^ 1 5 0_hfc|§ 

z>o ^<DMMMMx+n, ^ hy 21 o<d&* n <ssi 

50 > h 2 2 O^ilX^-r^o ^^»JT-2 3 5 ft Rtil 

fC, |g8gOlEtS^o yttDttfo-i-tty* f h€r»8Ui- 
5 0 1611 ^j/tV/'T-^-xyhy 2 20^ 

^yu 2 0 0 ^^"T^, 2 0 0 f*f^l^fc5feIB 

(Oif^Xf*. {fe^Jfe-C^ft-rSo lil6(O7 i -^2 0 

«ft3ft«iK<ftv^ r.co^f*. ftt¥ttt?*t>SivH± 
^0 felony - T?±XJkX*&ffl^m&htcb-r o /r 

0 0O*ft»»«HcmsBB«^, ^x-XyW2 
0 Of*,' <£j®7^;*^ . -fe>/^ yh 2 2 0^, I /o®j 

[0022] »ai/j:*lS»li"t?tt, >-^^^ 1 0 0 ft 
^^ccof 1 — y/u2 0 O^^L, ^eoo^-^f*. jS^^W^ 
^15 O&Xf* h • ^ 1 6 op^-e^/^5^ 

f*. IrIC^ h U— vi • ^v^^l 6 OlC^fU-C^^^T 
50 ^t^Srff45wi:^5o t 1 — X/U2 0 OdslSft® 
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F/r2 3 0Oio^/«fi/^ ;of-y/^|i/^ 
h 1 4 o (gp-f^ :of- yOwSrfstt-ra^i— ^ 
yhn h i 4 o) n ^coiettum 

*d|E« £ nt ^ 6 ffifSUc T * ir * i" 6 r fc lit # ft v \ 
H&Sco ^huoil c ofEtSffi/Tr 2 3 0 & 

[0 0 2 3] ffibfls^ ^FHOfil /OSftfls (Wt 
ISM^^rU * • ^r — ^/P2 0 0 

v^oc^ hllOlt ^ h W— v> • ^yrt 1 6 ok:*j-l 
[00 24] Ktt«9f*»Jfei-S^ y trv-^flWIHcio*. 

ID, 3 y h l 2 0 A^iftfM'S w i S: pJS 
»^SH*^-ttfcov*TR9H-*. r-^2 0 0 

2 o±T*^cfc^ ; s : 7i^^-r^^< kt iooi«i 

2 4 0, XtJ5*(0*riSi-S*3ffiWffli9f 2 3 0 £ 

<Wb) £*u ^ol i o i /o W^Tt^Jco i / 

T—Zf/U2 0 OttXfc, (Nw) «2.5 0^ 

tfo wjUfi, »JC-r5tt«M«fc«2 3 oKJR^Sftt^ 
^f*— V^mffi^Kb-Ctctv^^^ov^T^-To N 

B5^.Bi5wi:trprffiJc-r53&^T*>5« SMI2 4 0 
WNwM2 5 0lt y t:'>-^ • "t—-J>V<D3-^ h 

[0 0 2 5] «S3MMB2 4 Of*. T^^^^kStb^W 
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i oiaot i /osbf^^rii^TLct ? t-rst, *-<o^ 
ftol^-et, -7-7 trv^ • j-v?x/i> i i oi*W 
^7t-^3yhp-7 2ioi:i^§ 0 x-^xy 

M 1011 3^ hn-7 1 2 0jftSRSlC«Srigaii- 5 

v^xi* 10 011 T-y/U2 0 O^rrfclc^jc^nfc 

1 iftiotcx— y^2 o op^jco^v hy 21 o^n- 

MUiMl2 4 0^7^f^^no ^ 

(c, 7-^2 0 0H WfflricEtStStu-Cv^r— 7 

\?^tr . h i i ooff^^euiciot* 

fctbfcfcSlc:, SS3WH2 4 o£T^>f 7ifrtZ>Zt 
hx+$z> 0 iM!2 4 o^xy h y 2 i oic^^tr 
^> hy 21 ofticfoztiwm 

RXfiVm<0±XI±* UTV^afcV^tae 
[0 0 2 6] • x-i/ x y h l l Oi^jtcffiS 

-cHi$rtc N xyhy2iO(OiW7^7^^i» 
12 4 o^^--r5c<htcft6o =>yh^7l20W 
s/ • 31—^^ yn 10 B©a«*5te3fts||ijlKi- 

fp-7 i 2 o^c4ov^r i/oiMfflt^ £*>\cm 
ttto-rz^kic&^x. i/oW)ft&w±-r z> 0 ^<om 

30 fiMCJO, xivhn-^ 12 0(1 »*ft-^!/tr^^ • 
i-^yhiio, xiiiJI^ttivyfy^.x 
-Vxyhi l 0)55UE^(^^(c©^4xfCw t ^5: 
t^iot, tecD-^y tT>^ • > Ml O^rWI 

yh l l OJc^-r-Sx-^ • r^-fe^<oiBv^Rrffltt«:. 

[0 0 2 7] 9c\cm^\^ftX Nw«|2 5 0ft 

r^7"^y>ft;$n-5i:, xyhy 2 10lcJ;ot^^ti 
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X . Title of Invention 

Virtual Storage System 

2 . Claims 

1. A virtual storage system for linking a host to one or more 
storage devices over a network tbe system comprising: 

an agent connected to the host, the agent having volatile memory 
for storing a first copy of a table, the table having entries to map virtual 
disk positions to locations on the storage devices; and 

a controller coupled to the agent, the controller having non-volatile 
memory for storing a second copy of the table, tbe controller intermittently 
causing contents of the first copy of the table to be replaced by contents of 
the second copy of the table, 

whereby during an input/output (I/O) operation, the host accesses one of 
the entries in the table stored on the agent to determine one of the storage 
device locations. - 

2. The system of claim 1; wherein the table entries further 
include an indication of whether an invalid state is activated such that the 
invalid state for a table entry becomes activated when that table entry 
contains no useable mapping information. 

3. The system of claim 2, wherein the agent does not allow the 
host to complete the I/O operations with one of the entries if the invalid 
state for that entry is activated. 

4. The system of claim 1, wherein the table entries further 
include an indication of whether a no-write state is activated such that tbe 
no-write state for one of the entries becomes activated when data cannot 
be written to the storage location contained in that entry. 

5. Tbe system of claim 4, wherein the agent does not allow the 
host to write data to the storage location in one of the entries if the no- 
write state for that entry is activated. 

1 
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6. The system of claim 1, further comprising a communication 
channel to couple the agent and the controller. 

7. The system of claim 6, wherein the communication channel 
employs a data transfer protocol to transport messages on the 
communication channel. 

8. The system of claim 1, wherein the entries include an offset. 

9. The system of claim 8, wherein the offset includes logic unit 
number identifier. 

10. The system of claim 8, wherein the offset includes a block 
identifier. 

11. The system of claim 10, wherein the entries further includes 
a segment of virtual disk positions. 

12. A system for mapping a virtual disk segment to a storage 
location within a storage device, such that a host issues a I/O operation to 
an agent and the agent determines said storage location for input/output 
operations, said system comprising: 

a table having an entry corresponding to said storage location; 
a plurality of variables indicating states of the entry; 
an offset for the entry, wherein the offset includes a logic unit 
number identifier and a block identifier; and 
a memory to store the table. 

13. The system of claim 12, wherein the memory is volatile. 

14. The system of claim 12, wherein said storage location 
comprises a block of data within the storage device. 



15. The system of claim 14, wherein the block of data is about 1 

MB. 
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16. The system of claim 12, wherein the agent ia coupled to the 

host. 

17. The system of claim 12, wherein the plurality of variables 
comprise Boolean variable. 

18. The system of claim 12, wherein the states include an invalid 

state. 

19. The system of claim 18, wherein the plurality of variables 
includes a variable for the invalid state. 

20. The system of claim 12, wherein the states include a no-write 

state. 

21. The system of claim 20, wherein the plurality of variables 
includes a variable for the no- write state. 

22. The system of claim 12, wherein the states include a zero 

state. 

23. The system of claim 12, wherein the states include an error 

state. 

24. A method for performing an operation on a virtual disk 
coupled to a host within a network, comprising: 

specifying a block on the virtual disk within the operation; 
accessing o table mapping the block to a storage location on a 
storage device; 

issuing a corresponding operation to the storage device, wherein the 
corresponding operation correlates to the operation on the virtual disk; 
completing the corresponding operation; and 
presenting the completed corresponding operation to the virtual 

disk. 

3 
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25. The method of claim 24, wherein the issuing step includes 
issuing the corresponding operation from an agent coupled to the host. 

26. The method of claim 24, further comprising updating the 
table with a persistently-stored table residing in a non-volatile memory. 

27. The method of claim 24, further comprising determining 
states of the table. 

28. The method of claim 24, further comprising sending a fault 
message when the table is unable to be accessed. 

29. The method of claim 24, further comprising storing the table 
in a volatile memory. 

30. The method of claim 24, receiving updates for the table from 
a controller. 

31. A method for maintaining a table for mapping virtual disk 
blocks to storage locations on storage devices within a network, 
comprising: 

receiving a command from a controller at an agent storing the table; 
activating states within entries of the table; 
completing operations at the table; and 
updating the table in response to the command. 

32. The method of claim 31, further comprising setting a blocking 
flag until operations are completed. 

33. The method of claim 31, further comprising obtaining 
mapping information from one of the entries in the table. 

34. A computer program product comprising a computer useable 
medium having computer readable code embodied therein for performing 
an operation on a virtual disk coupled to a host within a network, the 

4 
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computer program product adapted when run on a computer to effect steps 
including: 

specifying a block on the virtual disk within the operation; 
accessing a table mapping the block to a storage location on a 
storage device; 

issuing a corresponding operation to the storage device, wherein the 
corresponding operation correlates to the operation on the virtual disk; 
completing the corresponding operation; and 
presenting the completed corresponding operation to the virtual 

disk. 

35. A computer program product comprising a computer useable 
medium having computer readable code embodied therein for maintaining 
a table for mapping virtual disk blocks fco storage locations on storage 
devices within a network, the computer program product adapted when 
run on a computer to effect steps including: 

receiving a command from a controller at an agent storing the table; 

activating states within entries of the table; 

completing operations at the table; and 

updating the table in response to the command. 
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3 . Detailed Description of Invention 

Related Applications 

This application claims priority from U. S. Provisional Application 
Nos. 60/209,109 and 60/209,326, filed on June 2, 2000, the disclosures of 
which are hereby incorporated by reference in full. 

field Qf Th e InveqtjoA 

The present invention is a virtu ali zed data storage system using 
distributed tables with input/output mappings. 

Background Of The Invention 

A stand alone computer generally connects to data storage devices, 
such as hard disk, floppy disk, tape, and optical drives, via a fixed 
communication channel or bus, as schematically illustrated in FIG. 1A. 
While the communication channel allows high- speed data transfers, access 
to the storage device is limited to the stand-alone computer. 

Over time, it has become necessary for multiple devices to connect 
to a storage device so that multiple users may share data. As a result, 
developers created a storage area network (SAN) consisting of multiple, 
interconnected, proximately located devices, as schematically illustrated 
in FIG. IB. The SAN typically includes one or more network access 
servers that administer the interaction, of the devices and the operation of 
the network, including data storage devices that are accessible by the 
other devices in the SAN. The devices may be connected through Small 
Computer Systems Interface (SCSI) buses to establish parallel 
communication. channels between the devices. In SCSI systems, a unique 
Logical Unit Number (LUN) is used to designate data storage locations, 
where each location is a separate storage device or partition of a storage 
device. Each LUN is further divided into blocks of small, easily 
manageable data sizes. By combining LUN zoning: with port zoning to 
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implement storage sharing, the SAN can have centralized, distributed 
data storage resources. This sharing of data storage resources across the 
SAN substantially reduces overall data and storage management 
expenses, because the cost of the storage devices maybe amortized across 
multiple devices. The use of centralized, distributed data storage also 
provides valuable security features because the SAN may limit the ability 
of a device to access data in a particular zone. The performance costs of 
using consolidated data storage configurations within the SAN are 
substantially reduced through the use of Fibre Channel connections 
between the LUNs and the other network devices to achieve high-speed 
data input and output (I/O) operations. The SAN operates, in effect, as an 
extended and shared storage bus between the host and the storage 
containers to offer, among other things, improved storage management, 
scalability, flexibility, availability, access, movement, and backup. The 
centralization of data storage, however, presents new problems, including 
issues of data sharing, storage sharing, performance optimization, storage 
on demand, and data protection. 

Because of these issues, developers have recently added a 
visualization layer to the SAN hierarchy. The virtualization layer refers 
to software and hardware components that divide the available storage 
spaces into virtual disks or volumes without regard to the physical layer 
or topology of the actual storage devices. Typically, virtual volumes are 
presented to the server operating system as an abstraction of the physical 
disk and are used by the server as if virtual volumes were physical disks. 
The virtual volumes are not LUNs on a storage array. Instead, the virtual 
volumes may be created, expanded, deleted, moved, and selectively 
presented, independent of the storage subsystem. Each has different 
characteristics, and therefore expanded as the available storage expands. 
The SAN virtualization presents a single pool of SAN resources and a 
standard set of SAN services to applications residing on a broad range of 
operating platforms. 

7 
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However, SANs using conventional disks and storage subsystems 
incur substantial system and storage management expenses due to the 
tight coupling between the computer system and the storage. Because of 
these and other reasons, the existing SAN technologies also have limited 
scalability. Furthermore, a key remaining issue for SAN visualization is 
the distribution of storage resources among the various devices of the 
SAN. 

Accordingly, there exists a need for an improved data storage 
system that addresses these and other needs in the SAN. One proposed 
class of storage system uses a subsystem to further improve the 
performance of the SAN by separating control and access functions from 
other storage functions. In such a class, access functions govern the 
ability to use and manipulate the data on the SAN, and control functions 
relate to the administration of the SAN such as device monitoring, data 
protection, and storage capacity utilization. Separating control and access 
functions from other storage functions pulls the virtu alization function out 
of the server and onto the SAN. In addition to the visualization of the 
storage provided by traditional, server bound implementations, the 
visualization layer on the SAN enables the automation of important data 
movement functions, including the copying, movement, and storage of 
data through the creation and expansion of virtual volumes. 

Toward this purpose of separating control and access functions from 
other storage functions, currently proposed visualized storage systems 
consolidate control and mapping functions in a centralized location such as 
in the host, in a storage controller, or in a special visualization component 
in the SAN, as illustrated in FIGS. 2A-2C respectively. Centralizing the 
control and mapping functions avoids problems associated with 
distributed mapping. However, storage visualization schemes that are 
centralized in one component suffer from various scaling limitations, 
including the inabilities of scaling to multiple computer systems, multiple 
storage systems, and large storage networks with adequate performance. 
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Improved scalability may be achieved through a distributed 
virtualized storage system. However, attempts to form distributed 
virtualized storage systems through the use of known technologies, such 
as array controllers, for distributing the mapping used in the virtual 
storage use simple algorithmic distribution mechanisms that limit data 
management flexibility, e.g. Redundant Array of Independent Disk 
(RAID). Furthermore, the known technologies do not address the needs of 
a scaleable virtual storage system, including issues of storage sharing, 
data sharing, performance optimization, storage system delays, and data 
loss risks. 

SUMMARY OF THE INVENTION 

In response to these needs, the present invention provides a system 
and method for creating virtualized storage in a storage area network 
using distributed table- driven input/output mapping. The present 
invention distributes the visualization mapping in multiple parallel 
mapping agents that are separate from a controller. This configuration 
allows the performance -sensitive mapping process to be parallelized and 
distributed optimally for performance, while the control of the mapping 
can be located in the controller chosen for optimal cost, management, and 
other implementation practicalities. The mapping agents store the virtual 
mapping tables in volatile memory, substantially reducing the cost and 
complexity of implementing the mapping agents. The controller is 
responsible for persistent storage of mapping tables, thereby consolidating 
the costs and management for persistent mapping table storage in a single 
component. Distributed visualization also allows the controller to 
manage multiple virtual disks used by multiple host systems, and even 
allows a single virtual disk to be shared by multiple host systems. The 
mapping agents preferably do not interact with other mapping agents, 
thereby improving the scalability of the virtual storage system and the 
virtual storage system's tolerance of component failures. 
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DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

As illustrated in FIQS.^aA-e B and 4 A 4BS the present invention 
provides a virtualized storage area network (SAN) system 100 using one 
or more distributed mapping tables 200, as needed to form one or more 
virtual disks 150 for input/output (I/O) operations between the hosts 140 
and storage containers 160. In particular, the table 200 contains a 
mapping that relates a position in the virtual disk 150 with the actual 
location on the storage containers 160. The specific contents of the table 
200 are described in greater detail below. 

The present invention covers an improved storage area network 
(SAN). The invention can therefore be applied to any known storage 
network 130. Within tbe SAN, it should be appreciated that the storage 
containers 160 are known and may refer to any type of present or future 
known programmable digital storage medium, including but not limited to 
disk and tape drives, writeable optical drives, etc. Similarly, the hosts 140 
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may be any devices, such as a computer, printer, etc. that connect to a 
network to access data from a storage container 160. 

Likewise, the storage network 130 is also intended to include any 
communication technology, either currently known or to be developed in 
the future, such as the various implementations of Small Computer 
Systems Interface (SCSI) or Fibre Channel. This distributed virtualization 
is most useful in environments where a large amount of storage is 
available and connected using some sort of "storage network" 
infrastructure. In one preferred implementation, the storage network 130 
is based on Switched Fibre- Channel connected storage. However, nothing 
in the design of the system 100 precludes its use on other types of storage 
networks 130, including storage networks that are not yet invented. 

The hosts 140 issues I/O operation commands to the virtual disks 
150, and in response, mapping agents 110 access the table 200. Although 
the agents 110 are generally associated with the hosts 140, in this way, 
the agents 110 isolate the table 200 from general host 140 access. 
Preferably, each of the hosts 140 has a separate agent 110, so that each 
host has a separate mapping table 200. Alternatively, the system 100 
could be configured so that more than one host 140 connects to an agent 

110. If multiple hosts 140 connect to the same agent 110, the hosts 140 
share access to the particular table 200. 

The agent 110 stores the mapping table 200 in a volatile memory 

111, typically DRAM. As a result, if one of the agents 110 shuts down or 
loses power, that agent 110 loses its copy of the table 200. For instance if 
the mapping agent 110 is embedded in the host system 140 and takes its 
power from that host system, as would be the case for a backplane card 
that serves as the mapping agent, the host 140 may cause the mapping 
agent 110 to shut down by eliminating power to the agent 110. However, 
by storing the table 200 in volatile memory, the table 200 can be easily 
and rapidly accessed and modified on the agents 110. Storing the 
mapping table 200 in volatile memory has the further advantage of 

1 I 



<$m 2002-91706 



substantially reducing the cost and complexity of implementing the agents 
110 as mapping components. Overall, the agents 110 allow the 
performance-sensitive mapping process to be parallelized and distributed 
optimally for performance. 

The system 100 further comprises a controller 120 that, although 
separate from the agents 110, administers and distributes the mapping 
table 200 to the agents 110. Control of the mapping is centralized in the 
controller 120 for optimal cost, management, and other implementation 
practicalities. The controller 120 further stores the table 200 in a semi- 
permanent memory 121 so that the controller 120 retains the table 200 
even after a power loss. The semi-permanent memory 121 is preferably a 
magnetic disk because of its high storage capacity and fast, frequently 
writing capabilities. The controller 120 may alternatively store the table 
200 using other forms of programmable storage such as writeable optical 
media and electronically programmable memories. The controller 120 
thus continues to store the table 200 even if the controller 120 shuts down 
or loses power. 

In this way, the responsibility for persistent storage of the mapping 
tables 200 lies in the controller 120, consolidating both costs and 
complexity. The exact design of the controller 120 is not a subject of this 
disclosure. Instead^ this disclosure focuses on the structure of the overall 
system and the interfaces between the mapping agent 110 and the 
controller 120. Accordingly, it should be appreciated that any controller, 
as known in the art of digital information storage, may be employed as 
needed to implement the present invention. Within this framework, each 
of the agents 110 preferably interacts with only the controller 120 and not 
with the other agents 110. As a result, the system 100 is highly scaleable 
and tolerant of component failures. 

As described below, the interactions of the controller 120 and the 
agents 110 are defined in terms of functions and return values. In one 
embodiment of the virtual mapping system 100 illustrated in FIG. 3A, this 
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communication is implemented with, messages on some sort of network 
transport, such, as a communication channel 132. In another 
implementation of the system 100 depicted in FIG\3fi( the communication 
channel 132 is the storage network 130 itself. Any suitable technique may 
be used to translate commands, faults, and responses to network 
messages. The communication channel 130 may employ any type of 
known data trasnsfer protocol such as TCP/IP. The particular interactions 
between the functions and activities of the controller 120 are described in 
greater detail below. 

FIGS. 4 A- i& schematically illustrate the contents of the table 200. 
As described above, the table 200 contains entries 210 (rows) that include 
a mapping between one or more virtual disk segments 220 and storage 
locations 230 on the storage containers 160. The storage locations 230 
identify the particular storage container 160 and part of the storage 
container 160 that corresponds to the virtual disk index 220. The form for 
the storage locations 230 must be appropriate for the storage network 
being used. In a SCSI network, each of the storage locations 230 includes 
a LUN identifier 233 and a block identifier 235, also called an offset. All of 
the other fields in a mapping table entry 210 are simple integers or binary 
state values. 

As depicted in 

FIG.kfc^ 

the mapping table 200 may have one entry 
210 per each "disk block" of the virtual disk 220. While possible to build, 
this would result in huge mapping tables and highly fragmented map pin g, 
both of which introduce undesirable performance degradations. In 
another embodiment, each mapping table entry 210 represents a variable 
sized group of contiguous virtual disk blocks that map to contiguous blocks 
on one of the physical storage containers 160. This configuration of the 
table 200 offers greater mapping flexibility and dense mapping structures, 
but introduces algorithmic complexity in managing the variable sized 
extents and greater map entry lookup costs. 

/ ^ 
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In response, the table 200 of a preferred embodiment uses mapping 
table en tries 210, each having a fixed size number of contiguous blocks 
("segments") on the virtual disk 150 that map to one storage container 
160, as depicted in FIG^4Sf. In this embodiment, each of the entries 210 
contains a virtual disk segment 220 instead of a virtual disk block. The 
block identifier 235 likewise identifies a corresponding segment of actual 
storage blocks. While FIG.V^illustxates the table 200 identifying an 
entire range of values for the mapping table entry 220 and the block 
identifier 235, the table 200 could likewise identify only the beginning or 
end block where the size of the actual and virtual storage segments is 
otherwise defined. While this configuration of FIG\^/for the table 200 is 
possibly not as dense as variable sized extent mapping, the configuration 
offers the simplest and highest performance map access and space 
management. Regardless of the specifics of the table 200, the table 200 
must map a virtual disk segment 220 to each physical storage block 
involved in I/O operations. 

In a preferred embodiment, the system 100 has multiple tables 200, 
each having different mappings between a virtual disk 160 and the 
storage containers 160. In this way, different hosts 140 may have 
different access to the same storage container 160. Where the table 200 
does not include one of the storage locations 230, hosts 140 using this table 
Ci.e., the hosts 140 connecting to the agent 110 that stores this table) 
cannot access information stored at the storage location. In fact, the host 
140 will not realize xhat this storage location 230 exists. 

During operation, the host 140 issues an I/O operation (e.g., read or 
write) to some block or blocks on a virtual disk 150. Each virtual memory 
block is represented in the mapping table 200, either as an individual 
entry or as part of a virtual disk segment 220. Each block contained in the 
I/O operation is mapped to the appropriate location on the storage 
container 160. The mapping agent 110 issues a corresponding I/O 
operation issued to the storage container 160. The I/O operation results 
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are then collected and presented aB a completed operation on the virtual 
disk 150. 

In addition to mapping information specifying the storage location, 
each mapping table entry 210 also contains several states. The states are 
Boolean variables that provide information on the current status of the 
virtual disk segment. These states are important because they allow the 
table 200 stored in the agent 110 to be remotely loaded and manipulated 
from the controller 120. These states and interfaces provide the ability for 
the mapping tables to be distributed and for the mapping table entries to 
be volatile. The disclosure first describes the states and, then, explains 
some of the functions for the states. The table 200 includes at least an 
invalid state 240 indicating whether any I/O operations may occur on the 
virtual disk segment 220 and its corresponding physical location 230. The 
invalid state may be activated during a first I/O operation to prevent 
further I/O operations until completion of the first I/O operation. In a 
preferred embodiment, the table 200 further includes a no-write (Nw) 
state 250 that indicates whether the data contained at the corresponding 
physical location 230 may currently be changed. The Nw state 250 allows 
for improved storage system performance because it permits data to be 
read during another I/O operation. The invalid state 240 and the Nw state 
250 function during dynamic loading of mapping table entries, dynamic 
mapping changes, volatility of mapping table entries, and data sharing 
among similar virtual disks 150. 

When activated, the invalid state 240 generally indicates that the 
mapping table entry 210 contains no useable mapping information and 
cannot support I/O operations. Any attempt to implement an I/O 
operation through this table entry 210 causes the mapping agent 110 to 
send a fault message to the controller 120. The agent 110 does not proceed 
with the I/O operation until the controller 120 returns a fault response. In 
one embodiment, the system 100 initially activates the invalid state 240 
for all entries 210 in the table 200 when the table 200 is newly created. In 
this way, the table 200 ignores any residual entries in memory from prior 
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stored tables to insure that current entries are active and reliable. 
Similarly, the invalid state 240 may be activated when entry 210 is 
"forgotten" and lost by the mapping agent 110 volatile memory. If the 
invalid state 240 is activated in the entry 210, then all other values and 
states in the entry 210 are assumed to contain no valid information and 
are ignored. 

Because the tables 200 located in the mapping agents 110 are 
volatile, any failure or restart of the mapping agents 110 causes all of the 
entries 210 to have an active invalid state 240. A sustained loss of 
communication between the controller 120 and mapping agent 110 also 
causes I/O operations to stop, either by making all mapping table entries 
revert to an active invalid state 240 or by adding additional mechanisms 
to suspend I/O operations until directed by the controller 120 to resume 
I/O operations. This configuration allows the controller 120 to continue 
coordinating other mapping agents 110 by knowing that a failed or 
unreachable mapping agent 110 has been placed into a known state, 
providing the controller 120 high availability of data access to the 
surviving mapping agents 110. 

As presented above, the Nw state 250, when activated, indicates 
that any write operations to the virtual disk segment(s) 220 represented 
by the entry 210 cause the agent 110 to send a fault message the 
controller 120. The agent 110 does not allow the host 140 to write to the 
storage locations 230 until the controller 120 returns a fault response to 
deactivate the Nw state 250 or until the system 100 otherwise takes some 
action to write to a segment despite the active Nw state 250. Unlike the 
invalid state 240, the activated Nw state 250 prevents operations from 
generating faults. Instead, the agent 110 generally allows the host 140 to 
proceed to access data at the storage location 230. Accordingly, if only the 
Nw state is activated, table entry 210 must contain a useable storage 
location 230. 
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In another embodiment, the table 200 further includes a zero (Z) 
state 260. When active, the 2 state 260 indicates that the virtual disk 
segment 220 represented by the entry 210 contains all zero bytes. This 
feature allows a virtual disk 150 to be created and appear to be initialized 
without the need to allocate or adjust any underlying non- virtual storage. 
If an entry 210 contains an active Z state 260, the agent 110 ignores the 
storage address 230. If the host 140 attempts to read information stored 
at storage address 230, the agent 110 returns only zero-filled blocks 
regardless of the actual contents of the storage address 230. On the other 
hand, any attempts to write data at the storage address 230 when Z state 
260 is active cause the agent 110 to send a fault message to the controller 
120. The agent 110 does not allow the host 140 to write to the storage 
locations 230 until the controller 120 returns a fault response that 
deactivates the Z state 260 or until the system 100 otherwise takes some 
action to write to a segment despite the active Z state 260. 

In another configuration, the mapping table 200 further includes an 
error (E) state 270. When active, the E state 270 indicates the existence of 
an error condition and provides the information necessary to instruct the 
agent to return an error without disrupting any previous state. The E 
state 270 is used where a pre-existing failure is known and such failure 
would cause any attempts at I/O access to fail. It should be noted, 
however, that the E state 270 could also be used as the means to issue an 
error status from a mapping fault. If an entry 210 contains an active E 
state 270, the agent 110 ignores the storage address 230. If the host 140 
attempts to read from or write to the storage address 230, the agent 110 
returns an error to the host 140. 

The interaction of the agent 110 and the controller 120 is now 
described in greater detail. In one category of interactions, fault/response 
operations, the agent 110 sends a message to the controller 120 indicating 
the occurrence of a fault during an I/O operation to the table 200. 
Typically, the fault occurs as a result of an activated state (as described 
above) that prevents the execution of the I/O operation by the agent. The 
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agent 110 sends the fault message is to the controller 120. The controller 
then determines an appropriate action and commands the agent 110 
accordingly. 

In one type of fault/response operation, a map fault, the mapping 
agent 110 alerts the controller 120 that an I/O operation requested by the 
host 140 cannot be completed because the mapping table entry 210 has an 
activated state that prevents the completion of the requested I/O 
operation. For example, the mapping agent 110 produces a fault message 
to the controller 120 in response to a request for any I/O operation to a 
table entry 210 having an active invalid flag 240 or an attempt to write to 
storage address 230 having an active corresponding Nw flag 250. The 
map fault message from the agent 110 generally identifies the requested 
I/O operation, the virtual disk segment 220 involved, and the table state 
preventing the I/O operation. When the fault occurs, the agent does not 
attempt to carry out the I/O operation. Instead, the controller 120 uses 
the fault message to respond to the faulted I/O operation (e.g. load map 
entry, change map entry, delay until some other operation has completed). 
The controller 120 response informs the mapping agent 110 how to 
proceed to overcome the cause for the fault. 

The controller 120 generally instructs the agent 110 either to 
resolve the problem or to send an error message to the requesting host. 
When resolving the problem, the controller 120 sends a replacement table 
entry 210. The agent 110 then inserts the new table entry 210 in the table 
(in place of the former faulty entry) and then retries I/O operation. If the 
controller 120 cannot resolve the problem, it instructs the agent 110 to 
issue an error message to the host. To cause the agent 110 to issue an 
error message, the controller instructs the agent to activate the error state 
260 for the table entry 210 causing the fault. As described above, the 
agent 110 then issues an error message to the host 140 regardless of the 
other contents of the table entry 210. 
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Commands to the agent 110 initiated by the controller 120 comprise 
a second category of interactions, command/response operations. Among 
these commands initiated by the controller 120 include the creation of a 
new mapping table 200 with all entries set to have an active invalid flag or 
the deletion of an* existing table 200. The controller 120 may obtain from 
the agent 110 the contents of one of the entries 210 or the status of the one 
of the states in this entry 210. The controller 120 can further order the 
agent 110 to set all of the contents for one of the entries 210 or the status 
of one of the states for the entry 210. It should be noted that once the 
invalid state 240, the error state 260, and the zero state 270 are active, the 
controller 120 cannot deactivate the state because, as described above, 
initial activation of these states voids the storage address 230. To 
deactivate these states, the controller 120 must instruct the agent 110 to 
replace the existing entry 210 with an entirely new entry. To each of 
these commands, the agent 110 returns a response to the controller 120 
after completing the ordered task. 

When the controller 120 instructs the agent to either set or obtain 
information from the table 200, the system optimally allows the controller 
120 to specify multiple, contiguous map table entries 210 in a single 
command. This arrangement allows the agent 110 and the controller 120 
to interact more efficiently and with fewer instructions. 

When the controller 120 commands the agent 110 to set one or all of 
the values and states in the table entry 210 p the controller 120 command 
to the agent 110 optimally includes a blocking flag. The blocking flag 
instructs the agent 110 to delay responding to the controller 120 command 
until after the completion of any I/O operations initiated before the 
command. The blocking flag applies to only that command in which it 
resides. Other concurrent commands and subsequent commands are not 
generally affected by the blocking flag of one command. In particular, the 
agent 110 immediately changes the table 200, as instructed in the 
command, but does not notify the controller 120 of this change until 
completing all previously existing I/O operations. In this way, the agent 

19 



(32) 



002-91706 



110 signals to the controller 120 the completion of all I/O operations using 
the former table 200 that do not reflect the changes to the table specified 
in the command. 

During a majority of the operation, the mapping agent 110 operates 
without faults. In non- fault cases, i.e. the mapping table entries 210 are 
valid and do not have any active states that prevent the requested I/O 
operation, the virtual disk I/O operates entirely through the mapping 
agent 110. Thus, all I/O operations proceed through the mapping table 
200 and directly to the physical storage containers 160 without any 
involvement of the controller 120. As a result, the controller 120 inserts 
itself into an I/O stream only when needed to perform various 
management operations and typically does not become involved in non- 
faulting cases, allowing the system 100 to have high performance and 
scalability. 

The foregoing description of the preferred embodiments of the 
invention has been presented for the purposes of illustration and 
description. It is not intended to be exhaustive or to limit the invention to 
the precise form disclosed. Many modifications and variations are possible 
in light of the above teaching. It is intended that the scope of the 
invention be limited not by this detailed description, but rather by the 
claims appended hereto. The above specification, examples and data 
provide a complete description of the manufacture and use of the 
composition of the invention. Since many embodiments of the invention 
can be made without departing from the spirit and scope of the invention, 
the invention resides in the claims hereinafter appended. 
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4 . Brief Description of Drawings 



FIGS. 3LA- IB * y HI Oil AltTj ■ axe known systems for connecting a host 
to a storage device; 

FIGS- 2A-2C{yRIOD ART] are known virtualized storage area 
networks; 

FIGS-LaA-SB'are schematic illustrations of a distributed virtual 
storage area network in accordance with embodiments of the present 
invention; and 

FI GS Si&rJf&a&e schematic illustrations of a mapping table for use 
in the distributed virtual storage area network of JF5€rr-3vinaccordaiice 
with an embodiment of the present invention. HH ' 
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FIG. IB 



(34) 



mm 2002 





(39) 



2002-91706 



. 1 . Abstract 

The present invention provides a system and method for creating 
vixtuaiized storage in a storage area network using. distributed table- 
driven input/output mapping. The present invention distributes the 
virtu aiization mapping in multiple parallel* mapping agents that are 
separate from a controller. This allows the performance- sensitive 
mapping process to be parallelized and distributed optimally for 
performance, while the control of the mapping may be* located in a 
controller chosen for optimal cost; management, and other implementation 
practicalities. The mapping agents store the virtual mapping tables in . 
volatile memory, substantially reducing the cost and complexity of 
implementing the mapping agents. The controller is responsible for 
persistent storage of mapping tables, thereby consolidating the costs and 
management for persistent mapping table storage in a single component. 
Distributed visualization also allows the controller to manage multiple 
virtual disks used by multiple host systems, and allows a single virtual 
disk to be shared by multiple host systems. The mapping agents 
preferably do not interact only with other mapping agents, thereby 
improving the scalability of the virtual storage system and the virtual 
storage system's tolerance of component failures. 

2 . Representative Drawing 
Fig. 3 



